Maximum Entropy Principle with General Deviation Measures
نویسندگان
چکیده
An approach to the Shannon and Rényi entropy maximization problems with constraints on the mean and law invariant deviation measure for a random variable has been developed. The approach is based on the representation of law invariant deviation measures through corresponding convex compact sets of nonnegative concave functions. A solution to the problem has been shown to have an alpha-concave distribution (log-concave for Shannon entropy), for which in the case of comonotone deviation measures, an explicit formula has been obtained. As an illustration, the problem has been solved for several deviation measures, including mean absolute deviation (MAD), conditional value-at-risk (CVaR) deviation, and mixed CVaR-deviation. Also, it has been shown that the maximum entropy principle establishes a one-to-one correspondence between the class of alpha-concave distributions and the class of comonotone deviation measures. This fact has been used to solve the inverse problem of finding a corresponding comonotone deviation measure for a given alpha-concave distribution.
منابع مشابه
Invertible mappings and the large deviation theory for the $q$-maximum entropy principle
The possibility of reconciliation between canonical probability distributions obtained from the q-maximum entropy principle with predictions from the law of large numbers when empirical samples are held to the same constraints, is investigated into. Canonical probability distributions are constrained by both: (i) the additive duality of generalized statistics and (ii) normal averages expectatio...
متن کاملStrengthened Large Deviations for Rational Maps and Full Shifts, with Unified Proof
For any hyperbolic rational map and any net of Borel probability measures on the space of Borel probability measures on the Julia set, we show that this net satisfies a strong form of the large deviation principle with a rate function given by the entropy map if and only if the large deviation and the pressure functionals coincide. To each such principles corresponds an expression for the entro...
متن کاملSpatializing Random Measures: Doubly Indexed Processes and the Large Deviation Principle
Here θ is a probability measure on a Polish space , Dr k k = 1 2r is a dyadic partition of (hence the use of 2r summands) satisfying θ Dr k = 1/2r and Lq 1 Lq 2 Lq 2r is an independent, identically distributed sequence of random probability measures on a Polish space such that Lq k q ∈ N satisfies the large deviation principle with a convex rate function. A number of related asymptotic results ...
متن کاملStrengthened large deviations for rational maps and Gibbs fields, with unified proof
For any hyperbolic rational map and any net of Borel probability measures on the space of Borel probability measures on the Julia set, we show that this net satisfies a strong form of the large deviation principle with a rate function given by the entropy map if and only if the large deviation and the pressure functionals coincide. To each such principles corresponds a new expression for the en...
متن کاملGeneralized-generalized entropies and limit distributions
Limit distributions are not limited to uncorrelated variables but can be constructively derived for a large class of correlated random variables, as was shown e.g. in the context of large deviation theory [1], and recently in a very general setting by Hilhorst and Schehr [2]. At the same time it has been conjectured, based on numerical evidence, that several limit distributions originating from...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Math. Oper. Res.
دوره 34 شماره
صفحات -
تاریخ انتشار 2009